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ABSTRACT 

The purpose of this paper is to provide the Director 
of the Office of Education Programs with an instrument with which to 
develop an educational data base for providing information to 
evaluate the education programs of the Bureau of Indian Affairs 
(BIA) • some specific issues and questions are presented along with 
background information. BIA educational information needs are 
identified in the following areas: assessment of needs, establishment 
of goals and objectives, planning for implementation, operation, 
evaluation, evaluation recycling, and pupil accounting. The proposed 
technical approach to the development of an education information 
program includes the utilization of a financial accounting sub* system 
and a pupil accounting sub-system. Steps suggested for the 
implementation of tli^se programs are that (1) reobding for the 
financial management sub-system should be completed early in Fiscal 
Year 1973, (2) elements of data should be collected in the^fall of 
1972 and made a part of the permanent pupil record system shortly 
thereiafter, (3) plans should be developed for collecting pupil 
enrollment and attendance information, (4) plans should be made to 
administer an appropriate standardized achievement test to all pupils 
in attendance at Indian schools, (5) work should be done to develop 
uniform terminology for pupils and curriculum, and (6) work should be 
begun on standardized evaluation methods. (PS) 
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I - FOREWORD 

A study was recently undertaken to assess the prospects for 
development and Implementation of an evaluation program for the Bureau 
of Indian Affairs Educational Programs operation* This program would 
follow the guidelines as established by the Department of the Interior. 

In the course of the Investigation ^ a critical deficiency was 
Identified In the collection^ storage^ and dissemination of BIA educa- 
tlonal data. Likewise » the basic Information requirements needed to 
specify needed data to produce usable reports were almost nonexistent. 
In some Instances , usable Information was available but In a form or 
level of detail Inappropriate for specific evaluative processes. 

The content of the report that fallows Is Important to the 
underlying need for a uniform reporting process. The results are pre- 
sented to demonstrate the need for a reporting process as a basis for 
an evaluation process. 

From all viewpoints » the requirements for a definitive reporting 
process that will provide useful^ decision-making Information at the 
school, agency 9 Area^ and Central Office are evident, A process for 
standardized terminology and data uniformity Is the first step toward 
establishment of a useful Information-gathering device. 

Since the most basic comprehensive data collection approach has 
not been Implemented » an evolutionary process based oh a miBnual rather 
than an automated system appears to be most viable at this time. This 
might well be termed a growth plan for development of a comprehensive 
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educational Information program. The evidence presented In this report 
supports such a consideration. 
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II « INTRODUCTliPN 



Department of the Interior guidelines for evaluating programs 
were released In the fall of 1971 allowing each of the Indlvlidual Bureaus 
to develop and Implement approptlate evaluation techniques and approaches • 
Planning responsibility for a Bureau of Indian Affairs evaluation program 
was assigned to the Chief of Management Research ^ nov reorganized Into 
the Office of Management Systetas. To date^ no formal action has been 
taken by the Bureau of .Indian Affairs to develop an organized evaluation 
program. 

Present efforts to evaluate programs for the education of 
Indian children by the Bureau of Indian Affairs have been reviewed and 
assessed. This process has been^ of necessity^ limited In time and 
scope of effort. The method of approach to Identifying basic needs of 
an educational program evaluation design has been developed. Because 
of the time and cost constraints which were forced on this effort » an 
involved background search was not feasible. A representative litera- 
ture search was undertaken to review the efforts of others In this area. 
Additionally 9 a conference with an Investigative team of the General 
Accounting Office » which has studied various aspects of the Bureau of 
Indian Affairs educational program^ was arranged In Los Angeles. This 
discussion with GAO study team members regarding their findings provided 
the means for rapid development of this report. 

Specifically » the purpose of this treatise Is to provide the 
Director of the Office of Education Programs with an Instrument with 



/ 

which to develop an educational data base for providing Information to 
evaluate the Bureau's education programs. 
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III - BACKGROUND 

Shortly after assuming the responsibilities of the Office of 
Education Programs In March of 1971 » the Director was called upon to pre<- 
sent and defend an educational plan to the appropriate subcommittees of 
Congress as support for the education budget. At these hearings » the 
Director had virtually no pertinent supporting Information to substantiate 
his position or to use as background material for answering the many 
pointed questions addressed to him. Thus^ the urgency for this necessary 
Information became apparent. 

REORGANIZATION OF OFFICE 
OF EDUCAnON PROGRAMS 

In the first of many moves to improve the effectiveness and 
effectualness of the Office of Education Programs » the Director submit- 
ted a reorganisation plan which was approved by the Department in August, 
1971. This plan realigned the many duties and activities of the Bureau's 
Central Office along functional lines. The major functional units iden- 
tified were: 

* Program Direction and Management 

* Policy Development and Legislative Review 

* Distribution of Resources 

* Education Research 

* Program Planning and Development 
Evaluation and Program Review 

* School Facilities Planning and Development 
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* Fiscal Planning and Budgeting 

• Communication Services 

SIMILARITY TO 

STATE EDUCATION AGENCY 

It should be noted at this point that the functional units 
above closely parallel those defined for State education agencies In the 
U» S. Office of Education publication^ Handbook VII » Standard Terminology 
for State Education Agencies * The Bureau of Indian Affairs Is unique 
among Federal Agencies In that It Is directly responsible for the opera- 
tion of programs normally Identified as being within the pervleir of local 
governments The responsibilities for operation of local schools by the 
Bureau of Indian Affairs In such a wide geographical area are awesome and 
demanding. 

BUREAU ORGANIZATION' CREATES 
PROBLEMS FOR EDUCATION 

As has been pointed out^ the Central Office of Education has a 
function very similar to meat State education agencies. In this case^ 
the Bureau's ''Education Agency" Is fitted Into an organizational struc- 
ture totally discordant with any reasonable approach to management struc- 
turing. Public schools are generally operated by State constitutional 
mandate as legal entitles under public boards of education » and are 
governed by the laws and regulations of the State* Bureau of Indian 
Affairs schools 9 to the contrary » are grouped under agency officers who 
report to an area director » who Is In line authority to the Commissioner 
of the Bureau of Indian Affairs. This situation would be analogous In 
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the public school sector by requlrlsig the Superintendent of Schools to 
report to the City Manager or a County Goomlssloner. Local comminltles 
decided years ago that the schools should not be required to compete with 
other public services for finance and favor with city politicians, hence, 
public schools were placed under the custodianship of boards of trustees. 

DIVISION OF EVALUATION 
AND PROGRAM REVIEW 

The newly established Division of Evaluation and Program Review 
within the Office of Education Programs Is a key functional unit. It Is 
the responsibility of this Division to plan» developt design^ and Imple- 
ment the processes and procedures for ongoing evaluations of the Bureau's 
educational programs. This function Is a very Important element In the 
development of Information to assist the Director In presenting and Jus- 
tifying priority needs for the education of Indian children. As the 
Government. Accounting Office states In Its report developed through a 
year's study of the Bureau's education programs » millions and millions 
of dollars have gone Into the education of Indian children with virtually 
no Information gained concerning attained educational results* 

GOVERNMENT AGGOUNTING 
OFFICE GRITIGISMS 

One of the major points made by the study Ceam of the GAO was 
' the fact that stated goals and objectives for Indian education were either 
nonexistent or» if in existence » universally ignored. Study team meoibers 
did acknowledge the current Director's efforts to restate Office of Educa- 
tion Programs goals and objectives. A favorable Impression of this 

^^^^^■^^^^-'^ 



III.4 



activity was indicated by the GAO. In addition to stressing the need for 
Bureauwide goals and objectives, the GAO pointed out the lack of decision 
making information available to program managers and the minimal data 
available on the measurement of student achievement. 
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IV ■ ISSUES AND QUESTIONS 

PROGRAM ISSUES 

For the past two or three years the need £or the development of 
an educational Information system and the Implementation of new programs 
for the measurement of student achievement has been discussed as "Program 
Issues** In documentation submitted to the Commissioner ^ Department » and 
Office of Management and Budget. These Issues have been presented as 
urgent considerations needed to Improve Indian education. Concurrent In 
urgency are standardized testing and MIS programs. The Director of Educa- 
tion Programs* critical objective Is to produce demonstrable results. 

PROBLEMS ARE NOT 
NEW TO EDUCATION 

On the plus slde^ many accomplishments have been achieved In 
the development and design of educational Information systems and measure- 
ment of student achievement. Products of these accomplishments In the 
education field are applicable to BIA« 

NEED FOR COMMON 
TERMINOLOGY 

One of the first problems to be solved In the development of an 
educational Information system Is data uniformity. This requirement was 
Identified In public education as early as 1930 when a group of State 
education agency representatives met to discuss the Issue. In 1953 » the 
first of a scnries of handbooks of standard terminology was published by 
the 0. S. Office of Bdocatlon« Handbook The Common Core of State 
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Educational Informatton « Identified and defined those Items of Informa- 
tion which were common for reporting educational Information from the 
local to the State and national levels. Since then, other handbooks have 
been developed cooperatively with icrepresentatlon and concurrence by all 
State education agencies and the majority of local school districts. 
Handbook II, Financial Accounting for Local and State School Systems ^ and 
Handbook III, Property Accounting for Local and State School Systems ^ were 
published In 1957 and 1959 respectively. A handbook about employed per- 
sonnel, Handbook IV, Staff Accounting for Local and State School Systems ^ 
published In 1965, was developed concurrently with Handbook V, Pupil 
Accounting for Local and State School Systems . In 1970, Handbook VI, 
Standard Terminology for Curriculum and Instruction In Local and State 
School Sys terns > was published. At the present time an additional hand- 
book on community profile Information Is underway. These handbooks, 
without doubt, will provide a basis for terminology and organization of 
an educational Information system for the Bureau of Indian Affairs. 

OTHER SIMILAR PROJECTS 

In 1958 with the enactment of the National Defense Education 
Act, Congress demonstrated, throu^ the provisions of Title X, a concern 
for the availability of accurate and timely Information about education. 
This title of NDBA, through the U. S. Office of Education, offered match- 
ing grants to State departments of education up to $50,000 for the purpose 
of Improving statistical services • Msiqr States used this money for Im- 
proving systems for collecting, processing, and disseminating data. As 
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indicated previously 9 a very important part of most of the State educa- 
tion agency programs was basing the revised reporting procedures on the 
handbooks of standard terminology. Also, using Title X money, many State 
education agencies utilized automatic data processing for the first time. 

Later, through funds provided under Title V of the Elementary 
and Secondary Education Act, State education agencies moved to higher 
levels of statistical sophistication with the development of educational 
information systems. Thirteen midwestem States Joined together to de^ 
sign the Midwestern States Educational Information Project (MSEIP). 
Individual State education agencies such as Alabama, California, Missis- 
sippi, New York, North Carolina, Pennsylvania, Rhode Island, Texas and 
Puerto Rico spent ndllions of dollars in the design of the most modem 
educational information systems. 
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V , BIA EDUCATIOMAL INFORtATION NEEDS 

The Office of Education Programs of the Bureau of Indian 
Affairs recognizes the urgency and the need for an educational Informa- 
tion system. Much has already been done In the public sector of educa- 
tion In the development of such systems* Although the BIA, as a Federal 
agency 9 presents a unique set of problems In the operation of schools at 
the local level, a great deal of the work already done by State education 
agencies can be transferred to the Bureau's school system, since systems 
designed with Federal funds are part of the public domain. 

PROBLEM STATEMENT 

The obvious lack of standardised data available to the decision 
makers of BIA prevents a desired evaluation outcome. The GkO report has 
alluded to this problem. The schools vhlch vera Investigated did not 
have standardised procedures and prrvtlces for accountability. Further, 
no methods existed for comparing thf. results or achievements of the 
Indian schools with each other or vlth the public schools In the States 
In which the Indian schools were located. 

In the public sector » the people are demanding that educators 
be held accountable for providing measurable results of student per for- 
msnce. This demsnd Is being eidilblted by a reluctance to approve addi- 
tional taxes to support the evmr^^loereaslng costs of education, more 
participation In school activrities, and greater interest In the actual 
operation of the schools. 
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Even though the Indian schools are faced with the same basic 
problem^ the magnitude of the problem Is somewhat different* The vast- 
ness of the territory encompassed by the Indian school operation defies 
comparison with public schools of any size or shape* BIA funds schoolii 
which are located In it^laska to the southern areas of Florida, and from 
the eastern shores of North Carolina to western California, Oregon; and 
Washington* This Immense area Is In Itself a constraint to management 
practices and the problems generated are extremely difficult to overcome* 

Other than the problems of accountability and comparison which 
have Just been introduced, a problem of actual pupil accounting exists* 
The methods and procedures which have been set forth In the past to 
account for the pupils who are attending the Indian schools are entirely 
unsatisfactory* The declslon^nakers are hard put to make Justifiable 
decisions when they don't know the details of population for which the 
decisions will affect* 

The two problems of accountability which have been briefly 
presented above, evaluation (accountability of achievement) and pupil 
accounting (accountability of attendance), are the focus of this problem 
statesent* 

EVAUIATIOW 

During the past decade, evaluation has became a hl^ly visible 
function in the educational processes* The literatvrm is filled with 
techttlqoes and procedures for evaluation* Consulting firms tiave quickly 
established departmsnts for "^evaluation'* with "evalomtion specUlUU" 



as directors* The whole thrust of evaluation was probably brou^t about 
by the impact of large amounts of Federal funds made available to the 
schools* In all probability ^ the passage of the Elementary and Secondary 
Education Act of 1965 made the heaviest impact* Suffice to say at this 
point that none of the schemes which have been presented are the panacea* 
Nevertheless 9 evaluation procedures are more fully developed today than 
they were several years ago* 

Perhaps the most effective evaluation procedures which have 
surfaced result from the development and implementation of systems of 
management by objectives; or a planning » programming » budgeting system 
(PPBS). Evaluation is an integral part of any such system for manage- 
ment by objectives. 

The steps which should be taken in the development of any such 
a system are as follows: 

^ An Assessment of Needs 

^ Establishment of Goals and Objectives 

* Planning for Implementation 

* Operation 

* Evaluation 

* Recycling 

A complete cycle from assessment throng evalttation is coamonly tmown as 
the education contimram. 

(a) Assm— snt of Weeds 

The total administrative argaiiisatlom should be Involved with 
the needs asMssment from the poplla mho are the aetnal reeltrfLents o£ 



V.4 



the process to the top administrator In the organization. Relevant ser- 
vices which are to be subsequently rendered should be Included In the 
needs assessment Including anticipated academic performances ^ physical 
characteristics 9 and others which are deemed Important by the assessors. 
The assessment of needs should be categorized Into a workable document 
with needs of similar characteristics being catalogued together. In the 
Instance of this investigation ^ evaluation of pupil accomplishments and 
pupil accounting techniques are the foremost needs of the BIA at the 
present time. 

(b) Establishment of Goals and Objectives 

The needs which have been outlined above must now be translated 
Into goals and objectives. For purposes of this paper » goals are defined 
as statements of purpose uhlch coanunlcate Intended program objectives. 
Goals are not stated In time nor quantified by degrae of attainment. 
Most school districts have such broad goal statements usually entitled 
philosophies of the sthool district^ aims of the school district or some 
such general title. Goals are normally developed by the top levels of 
the administrative helrarchy and dlssodnated downward througli the orga- 
nization. BIA has an established goal i^ich In effect states that "BIA 
will provide an education program for Indian pupils , the results of which 
will be equal to that enjoyed by other AsMrican pupils." 

After the defittltion of the goals » the ensuing step is the 
definition of specific objectives. Objectives may be defined as a de- 
sired quantifiable aceoipllstamuit within a specific time framework. 
Bach objective most relate to a specific goal» mmt be measurable » must 

19 
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state the method of measurement, oust Indicate the evaluation criteria, 
and must state the time period for achievement. A project at the Chllocco 
Indian School under the direction of BIA personnel follows these guide- 
lines and procedures. The project Is known as Off Reservation Boarding 
Schools (ORBS). 

Objectives then represent measurable achievements , the attain- 
ment of which Advances the school In the direction of established goals. 
Documented objectives are almost nonexistent In school districts. Such 
is the observed case of BIA schools. Existing statements of philosophy » 
assumptions 9 or Intent are not items of quantifiable nature , nor are they 
projected within a time frame. Integral to meaningful objectives are the 
evaluative criteria by which the effectiveness of programs in attaining 
objectives will be measured. 

Meaningful program effectiveness will be the most difficult of 
problems encountered in the development of management by dbjectives. 
Very few, if any, systems and procedures are established in BIA for mea- 
surement, other than standardised tests for measuring of performance in 
the basic educational areas such as computational skills and reading. 

It is recognised that there are areas of the total educational 
process lAlch are not, and some irtiich cannot be, evaluated quantitatively. 
Most of these unique or special areas could be subjectively evaluated, but 
documented subjective evaluation is virtually nonexistent. There are very 
few successful subjective evaluation reports on file im most school die- 
trlcts. AlthM^ this 1. a difflcolt atm nqnlring .IgnlflcMt effort, 
elwr. is gMftnftl agr.Minc iaeitg mduuMn that getttrallMd fabjMtlve 
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evaluative Instruments are necessary and can be developed. A system of 
management by objectives holds promise o£ providing effective means to 
school operators in breaking the evaluation logjam. 
(c) Planning for Implementation 

After the needs, goals, and objectives have been clearly set 
forth, the problems related to the implementation of a program can be 
addressed. If the goal of BIA states that a program of education shall 
be provided for Indian pupils equivalent to all other American pupils, 
then specific incremental objectives directed toward this goal must be 
set forth. For example, one incremental objective mi^t state that all 
Indian children should attain a standardised achievement test score at 
or near the national norms. The incremental objective should further 
state that this achievement should be accomplished prior to some future 
date. 

Since all children may not achive the desired objective, plan- 
ners should be realistic in setting objectives. Objectives should be 

updated, strengthened, and clarified during the course of the project or 

« 

program. 

In general, programs should be Implemented which are directed 
toward the objectives or which provide additional support to progress 
toward the objective. 
(d> Operation 

Af tet deciding lAlch programs are required to meet the defined 
needs of the populi^tlon and programs am developed to meet the objectives,, 
operation la begun* total resources*«>»pmcvl^f ImlldlngSy auppllaa, equip- 
mmnt, and managemmnt sktlla-»<^cctt be foeoted on the oibjeetives* 
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(e) Evaluation 

Evaluation oust be both objective and subjective. Objective 
evaluation will be associated with a definitive type of measuring Instru- 
ment such as an achlevenent test. During all of the furor concerning 
evaluation of pupil progress and the attalnaent of objectives over the 
past few years, much has been said and written regarding the effective- 
ness of standardised achievement tests to measure pupil achievement 
(i.e. evaluation). Sound basic arguments, both pro and con, have been 
presented. 

On the one hand, opponents of standardised achievement tests 
contend that these tests are "equal" only for the white middle class 
American pupil; a universe on which the' tests are standardised. Oppo- 
nents also state that the tests are culturally biased. This -is perhaps 
true. Another opposing view being expressed U that tests fall to cover 
many Important areas o£ instruction. Tests, they contend, measure read- 
ing comprehension, aritfaaetic reasoning, arithmetic computation, and the 
like, but fall to measure the desire to read and calculate, prevent 
expressions o£ vocational expectations and self image, and frustrate 
creative Information application. Still another argument proposes that 
test design may influence the pupil's success. A student's score on a 
test may be influenced significantly by how the questions are presented 
to him as well as by his ability to answer the questions theMelves. 

test antagonists express the feeling that foimulas of soae measures 
«te so difficult to cMpmhend, especially for younger pupils who are not 
"test wise," that the test merely measnras th« pvpil*s ability to take a 
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test* Instructions, to be sure, can stray from a "standard" since they 
are normally glvenby the classroom teacher and not a trained psycometrlst. 
Test makers have tried to Influence this factor of nonstandardlzatlon with 
printed Instructions to be read for test administrators; however, these 
may often be overlooked by the busy teacher. 

On the other hand, there are those proponents who maintain that 
standardized achievement tests are the only true objective Instruments 
presently available* These tests, they argue, must be depended upon un- 
til such time as better luid more reliable Instruments can be developed* 
Rather than use nothing at all. It Is logical to use that which Is avail- 
able for a specific purpose and carefully assess the results In ll^t of 
the deficiencies* 

In any discussion of standardized achievement tests and their 
use with restricted populations which may be considered culturally de- 
prived In terms of the major culture, the theory o£ th6 development of 
a specific test to meet the specific needs of the group to be measured 
Is advanced* The rationale of this approach has been countered with two 
arguments* 

First, most school organizations feel that they cannot afford 
the asKMint of OKmey necessary to go through the procedures of developing 
and proving a standardised test for a restricted population* Second, 
the use of i^ueh an Individualised test eliminates the capability of con- 
paring such special category students, such as Indian pupils, with stu- 
dents Itt the major culture* 

In snmairy, the baste problems with standardised tests lie In 
mlsusa of results ratfiar than daflelenclss m the tests » Mich of the 
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controversy can be overcome by Insuring that tests and test results are 
properly used. In this regard^ the uses of standardized tests as eval- 
uation tools are being reviewed In detail by a BIA Task Force on Testing. 
This group will be developing guidelines for the selection^ administration, 
and analysis of test Instruments and procedures for reporting results • 
• Subjective evaluation Is the type of yardstick which Is most 
commonly used by society In general andy therefore » by schools. Subjec- 
tive evaluation relates to one person's opinion of another. This type 
of evaluation can be further enhanced by the use of checklists ^ rating 
scales 9 and the like. Again there are proponents and opponents of sub- 
jective evaluation^ but the arguments are not quite so strong as those 
concerning standardized tests. The weaknesses and inabilities of the 
evaluator are most often to blame for a poor evaluation. A good teacher 
can say whether a pupil Is progressing In his normal way the same as a 
good school administrator can subconsciously rate his subordinates. This 
method can» hoi9ever» lend itself to substantial criticism. 



programs were recently discussed by Sorenson*t in which he outlined eight 
basic principles of evaluation which are pertinent to the current problem. 
These principles are as follows: 



Principle 1 . The purpose of any instruction program 
Is to produce measurable changes In the students for 
whom it was designed; if these changes do not take 
place » something may be wrong with the program or how 
it was implMmted. 



Sorensottt 6# '^Evaluatloa for the Improvement of Instructional 
Ptognnm: Some Practical Steps.** Bymluatlon Coietit . Janumry^ 1971 
Vol* 2» Ho. 4» pp. 13-17. . 



The uses of evaluation as a tool for Improving educational 




V-IO 



Principle 2 , For any Instructional progranii It Is 
essential that the goals of the program— whether 
they Involve knowledge, feelings, or attltude8--be 
defined In terms of performance , behavior, or actions. 

Principle 3 . Instructional procedures should be 
designed to fit the prestated goals— to teach the 
students the kinds of performance specified. 

Principle 4 . The program developer should follow 
a theory or model of Instruction. 

Principle 5 . Instructional programs should be 
repeatable. 

Principle 6 . Instructional programs should be pre- 
tested. 

Principle 7 . Since any given Instructional program 
will work more effectively with some students than 
with others, the formative evaluation plan should 
be designed to obtain Information about the charac- 
teristics of the students, especially those ^o did 
not learn from the program. 

Principle 8 . Formative evaluation requires a 
particular array of roles, skills , and tolls which 
have not traditionally been employed In developing 
instruction programs* 

These principles will provide an economical outcome if closely 
adhered to* 



(f) Recyclltttt 

Throughout the processes of the five steps noted above, re- 
vision should occur as the need becomes apparent, particularly during 
the evaluation phase. Mistakenly, some educators who eaiMttk upon a 
system of management by objective wait until the end of the evaluation 
cycle, whether it be s^ral months or several years, before th^ lnl« 
tiate the reeyeling procedure, tfaiting deprives the system of ttm 
advantages of fmstul iate update and process assassment which would be 
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available through Immediate Implementation. In addition /postponing 
Identified corrections or changes may be economically umd.se* 



PUPIL ACCOUNTING 

The student Is^ obviously » the central figure In any program 
developed for the educational system. His needs ^ as related to the 
communlcal and societal objectives » must be directly and effectively 
met* Specifically 9 the community direction and Its relation to the 
major culture plus Its own Intrinsic goals must be considered In order 
to effectively set measures for Pupil Accounting, The U* S. Office of 
Education Handbooks set out the general framework for elements of a 
%odel" approach. Certain other elements should also be Included In 
the Initial BIA approach. Following Is a tentative listing of appro- 
priate Information applications for such a BIA Pupil Accounting struc- 
ture: 

1. Enrollment This Is a wide ranging category 
which would Include information concerning 
pupil entrance into the present situation^ 
continued membership and withdrawal. 

2. Class Scheduling — Operational information 
concerning what subject options should be 
offered t the potential student loads » the 
space needs and limitations » personnel avail- 
ability and any special requirements. 

3. Class Lists — A functional capability of 
the systems used to generate listings of the 
students in specific class locations. 

4» Pupil Attendance --An ongoing, continual 
up-date of specific meinbershlp of ^ school 
organization by pupil count . 
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5, Grade Reporting A permanent record file 
of grading, of student progress reportable In 
fpeclflc (student) or global (class » schooly 
unity universe) terms. 

6, Test Scoring and Analysis At critical 
Issue In this element Is the development of 
a reporting procedure that provides essen- 
tial learning diagnostic Information on a 
timely basis and at the same time provides 

..^--Operational diagnostics for effective manage- 



ment. Situational environments^ Individual 
goals and consideration of community goals 
must be Included In Interpretative analyses 
of this data. 

7. Student Activities — The relationships 
between the academic progress of a student 
and the exposure to ancillary activities 
has been clearly established. Activities 
that directly or Indirectly bear on the 
attainment of Individual and coimminlty ob- 
jectives should be relevant for Inclusion 
In this reporting process. 

8. Bus Scheduling — Consideration of the 
transportation of students as part of the 
entire educational process Is essential. 
Attitudes 9 external concerns and community 
concerns must be considered along with the 
economic requirements. A process that In- 
corporates all the Issues and deals with 
total requirements is needed. 

9. Permanent Student Records File The 
student records transfer project Is ad- 
dressed to this specific Issue. The 
standardization of data and uniformity of 
reporting Is essential to development of 
an operational approach. Once permanent » 
uniform records are established^ the total 
task of student Identification and progresa 
report j^ng Is simplified. 

10. Records Management — As part of any Pupil 
Accounting ays tem» a concise training pro- 
gram In the Implementation y maintenance and 

.updating of the records Is essential. All 
persons engaged In the a8seiid>ly or handling 
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student data must be well versed In 
the uniform processes developed. A con- 
tinuing program for keeping the operational 
personnel Informed must be Instituted. 
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VI - DEVELOPMENT OF AN EDUCATIOIBIL INFORtAnON PROGRAM 

TECHNICAL APPROACH 

Basic to the Implementation of a sophisticated system of man- 
agement by objective Is a process which establishes a discipline for 
collecting 9 handling 9 and reporting data* As In the case of management 
by objective^ the literature Is filled with studies » conceptualizations » 
and approaches to the development of a viable management Information 
system^ or as It Is commonly called » MIS. Some efforts are obviously 
being made toward the development of such a system for the Indian schools; 
however^ an apparent lack of comprehensive planning Is evident* 



example^ a total Financial sub-system has been Implemented which can 
form one of the key elements fbr a total system. Some Information con* 
earning Staff Is also available* The staff Information Is resident In 
employee files but does not have the capability of being accumulated 
Into a more adequate file of educational Information* In addition » some 
Facility data with limited Information concerning property management Is 
available* To a lesser degree^ Comminlty Profile Information Is avail- 
able* In general 9 the Community Profile Information covers census 
characteristics and does not contain data on tribal roles or tribal lands* 
Considerable work would be necessary to collect and analyze the data for 
a usable Information source* 

A Program or Curriculum sub-system (course offerings » profes- 
slonal8\ materials t programs support) has not been developed at this time* 



Certain parts of such a system are being developed* For 
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This 8ub-8y8tem must be considered along with the other parts of the 
total system. After the Pupil Accounting sub-system has been generated 
as a first priority, the Program or Curriculum sub-system must be con- 
structed.. 

From the Investigations and fact finding conducted during this 
study 9 It Is quite apparent that the sub-systems which will serve BIA to 
the greatest advantage, while earnest efforts are being made to set up a 
viable evaluation system, are the finance sub-system and the pupil sub- 
system. However, a viable evaluation system would be extremely difficult 
to realise without a solid financial and pupil base. The data elements 
normally maintained In these sub-systems are uniquely Important to eval- 
uation. 

FINANCIAL ACCOUNTING SUB-SYSTEM 

It has previously been mentioned that the Bureau of Indian 
Affairs, through Its Data Center located In Albuquerque, New Mexico, has 
concentrated Its systems efforts In administrative applications such as 
payroll and financial accounting. At the time of this report negotia- 
tions were well underway between representatives of the Director, Office 
of Education Programs, and the Director, Fiscal Plans and Management, to 
Implement educational Information requirements In the proposed revised 
BIA financial accounting systems. Agreements have been reached by these 
parties concerning the necessary revised coding structure required by 
education programs and It Is assumed that these changes will take place 
as scheduled by July 1, 1972 « 
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PUPIL AccomrriNG sub-system 

The pupil sub-system Is somewhat different from other data 
flies In that there are substantially more data elements to be Included 
In the sub-system. The needs and wishes of the decision-makers should 
be foremost In the selection of the elements since numbers of elements 
are almost Infinite. In the particular case of BIA, efforts are cur- 
rently being made by Mr. Wall In the Albuquerque Area Office of BIA to 
develop a Student Record Transfer System (SRTS). The data elements de- 
tailed therein are the 9pes that are felt to be needed most by the users. 
It appears at this time that the membership and attendance elements In- 
cluded In the proposed file are essential to accountability and evalua- 
tion needs of all administrative levels of the BIA. The elements which 
Wall has proposed, and most certainly agreed with In this study , are as 
follows: 

Social Security Number 

Surname 

First Name 

Middle Name 

Suffix 

Nlckname/Dlmlnutlve 
Sex 

Blrthdate 

Verification of Blrthdate 
Home Address 

Female Head of Household 

Relationship 

Male Head of Household 

Relationship 

Tribe 

Family Number 
Tribal Enrollment Nuniber 
Language Spoken In Home 
EnroIIee*8 Rank In Family 
Rellglbus Preference 

Authority for Stated Religious Preference 
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• Agency 

School 

Teacher 

Room Assigned 

Year / Level /Grade 

Type o£ Student: Walk-Bus -Board 

Type of School: Ony Off ^ Public ^ Mission 

Type of Program: K-III^ Jr. Hlgh^ Non-Graded Primary 

Dorm Eligibility: Isolation^ Social » Academic 

Bus Route and Stop 

Attendance: 

School Membership this School Year to Date 
School Attendance this Schijol Year to Date 
Same for Four Previously Attended Schools 
Full School Year's Equivalence of Attendance 
Dormitory Menibershl^ this School » This Year to Date 
Dormitory Attendance this School » This Year to Date 

These elements compare favorably with those agreed upon for 
a migrant Information transfer system which was funded by a Federal grant 
and developed at the University of Arkansas In 1970. 

In any discussion of systems and their development the problem 
of method arises. The Indian Affairs Data Center » located In Albuquerque 
New Mexlcot Is making some strides forward In the collection and storing 
of data. The Center Is a well-established and highly competent operation 
Involved primarily In operational activities such as payroll » financial 
accounting^ and other administrative applications. With current hardware 
and personnel 9 the Center currently appears to have the capability to 
handle pupil data with little further effort » particularly pupil account- 
ing and test-scoring applications. 

As far-flung and disbursed as the Indian schools are^ the' cost 
of on-line transmission between them and the computer center would be 
prohibitive. U« S. mall or courier service delivery of the da.ta from 
the Center to the user would provide sufficient lead-time for decisions 
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which need to be made. At the present time BIA area of flees have encoder 
capabilities. There Is a possibility that each area will serve as a re- 
ceiving base from lADC; however » It appears that this approach Is not 
Innedlately feasible because of distances and cost* 

This Investigation has revealed .that most needs of BIA would 
be met with a pupil attendance reporting system which would provide hard 
copy reports to the Director of Education Programs on a monthly or 
quarterly basis. Such a system Is viable as well as economical ^ and the 
scope Is (Such that present facilities would not need to be extended* 

In general terms » the evaluation system and the pupil account- 
ing system should be Introduced Into the records of. BIA with all possible 
haste* ^A suggested outline of Implementation considerations will be pre- 
sen ted In the next section. 

PROPOSED IMPLEMENTATION PLAN 

By following the suggested steps listed below^ BIA can soon 
achieve the recommendations of this paper. 

(a) Office of Education Programs suggested receding for the 
financial management sub-system should be programmed and completed early 
In Fiscal Year 1973. 

(b) Elements of data suggested In SRTS should be collected In 

the fall of 1972 and made a part of the permanent pupil record system 

it 

shortly thereafter. ^ 

(c) Plans should be developed and Implemented Immediately 
(sunner 1972) for collecting pupil enrollment and attendance Information 
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using manual reporting procedures. Quarterly reports will suffice until 
such time as the sub-system Is refined so that monthly reports can be 
produced* 

(d) Plans should be made to administer an appropriate stan- 
dardized achievement test to all pupils In attendance at Indian schools 
during th e 1972-73 school year . A pre-test In early fall and a post- 
test In late spring are highly reconmended. Regardless of the arguments 
that current Instruments are biased In favor of middle class white 
American children^ these are all that are available currently. They 
should be used for evaluation and comparison until such time as better 
Instruments are developed. 

(e) Manual procedures for pupil accounting presently exist 
at the school/ agency and area levels of BIA education. Hotrever^ there 
is no uniformity In the terminology used. In the Interim prior to future 
automation^ new forms and procedures should be developed utilizing stan- 
dard terminology. Each Assistant Area Director should serve on a committee 
to develop and agree on the standard terms. USOE Handbooks are recomnended 
as a base for this standard terminology. 

(f) In addition to standard terms about pupils, work should 
coanence Immediately to develop uniform terminology on curriculum. This 
Is the vital link In any MIS effort. It Is the single Information area 
i9hlch touches on all the other sub-systems; finance, pupils, staff, 
property and community. 

(g) ^ Work should begin on the preparation of standardized 
rating scales, post-graduate examinations, and standardized chi^sck lists 
to farther enhance the evaluation process. 
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With the above recomnendatlons^ the BIA will be well on its 
way to establishing a satisfactory evaluation and pupil accounting sys- 
tern, 

icisigicieieieicicic 

The researcher takes this opportunity to express his apprecia- 
tion to Mr. Jerry N. Waddell and Dr. Tom Hopkins of BIA and to GAO for 
their assistance in the collection of background information and fact 
finding for the above effort. 

He hopes that suggestions and recommendations made herein will 
assist and direct the upgrading of education for'American Indian children. 
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RESEARCH AND EVALUATION REPORT SERIES 



The Education activity of the BIA has always produced a large and 
steady nuniber of very useful reports. In recent time, there seems 
to be an increasingly larger number of high quality reports. Too, 
throughout the years, there has not been an attempt to organize or 
arrange the reports in such a manner that they becane a useful and 
systematic body of infoimation. In order to provide a systematic 
arrangement of high quality reports so that they may be made avail- 
able to BIA educators, a Research and Evaluation Report Series has 
been established by the Indian Education Resources Center (lERC) , 
Division of Evaluation and Program Review. 

The general objectives of the Series are to: 

(1) Provide a systematic arrangonent of education reports. 

(2) Identify those reports considered to be high in quality. 

(3) Make pertinent data available to BIA educators and when 
possible, to educators outside the BIA. 

(4) Make it possible for professional educators involved in 
research pertinent to the schooling of Indian children 
to share their experiences with a greater audience. 

(5) Assist in the overall evaluation process of the BIA 
Education activity. 



